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WO 2005/069605 PCT/FR2fl04Z003390 

ANTI-GLARE DEVICE, METHOD AND ACCESSORY, AND IMAGING 
SYSTEM WITH INCREASED BRIGHTNESS DYNAMICS 

The present invention relates to a device and a method 
5 for modulating an image received by an image sensor in 
order to avoid the glare from intense sources and 
increase the brightness dynamics. 

Such devices can form active sun visors for 
10 automobiles, boats or aircraft, or observation means 
enhanced for night vision or security. The method can 
also be applied to improve a cinematographic or 
photographic device . 

15 The prior art includes US patent application 
US02 0071185. This patent describes a system and a 
method of dynamic optical filtering which blocks the 
intense light sources without affecting the rest of the 
scene. A sensor measures the intensity and the position 

2 0 of the light so that the selected cells of a filtering 
matrix mask the or each intense light source. The 
incident image passes through a beam splitter 
transmitting a portion to said sensor, and the other 
portion to an exposure camera placed behind the 

25 filtering matrix. 

Also representative of the prior art is US patent 
US2 0 02/ 012 0 64 . This patent does not relate to the 
acquisition of moving pictures , but photographic 
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applications. The problem is therefore different since 
there is no ongoing and real-time recalculation of a 
variable image. Moreover, this document does not 
disclose the characteristic concerning the position of 
5 the active filter in the focal plane of the input lens. 

US patent 4918534 relates to a device intended for 
medical imaging for scenes corresponding to recovery by 
an image intensifier. This document does not disclose 
10 the characteristic concerning the position of the 
optical filter in the focal plane. 

This solution of the prior art involves the use of a 
sensor for analyzing the unprocessed image, and a 

15 camera for acquiring the image processed by the filter. 
The beam splitter reduces the brightness of the image 
acquired by the camera. The object of the invention is 
to propose a technical solution rectifying these 
drawbacks , in order to make it possible to produce a 

2 0 more compact and less expensive device, exhibiting 
superior optical qualities. 

To this end, the invention relates, according to its 
widest meaning, to an ant i -glare device comprising an 
2 5 image sensor, a visualization means for reproducing the 
image and an adaptable light modulator presenting a 
filtering modulation controlled by said image sensor, 
said modulation presenting masking regions obscuring or 
attenuating the glare regions, characterized in that it 
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comprises a single image sensor handling both the 
analysis function for controlling the adaptable light 
modulator and the function for recording the modulated 
image . 

5 

The term "image sensor" is used in this patent to 
signify a means of acquiring an image in the light 
spectrum, and delivering an electrical signal . This is, 
in particular and not exclusively, a charge -coupled 
10 device, CCD, a microbolometer matrix, a cathode ray 
tube camera, a charge -multiplying sensor. 

The term "light modulator" is used in this patent to 
signify a means presenting transmission or reflection 

15 regions that are variable and controlled by an 
electrical signal, which is inserted into the field of 
view of the image sensor. It can be, for example, a 
liquid crystal screen or an MEMS type micromirror 
array. The "transmission rate" of the light modulator 

20 is understood in this patent to be the fraction of the 
light that the modulator transmits to the image sensor, 
whatever its modulation type (transmissive , reflective, 
transref lective , etc) . Vtmax denotes the maximum 
transmission rate of the modulator ("white"). Vtmin 

25 denotes the minimum transmission rate of the modulator 
("black"). Vtmax/Vtmin = c, with c > 1. 

The term "analysis mode" is used in this patent to 
signify the situation where the electrical signal 
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delivered by the image sensor is intended to be used 
for the generation of the modulation signal controlling 
the light modulator. 

5 The term " recording mode " is used in this patent to 
signify the situation where the electrical signal 
delivered by the image sensor is intended to be used 
for the generation of the signal to the visualization 
means, for the recording or reproduction of a modulated 
10 image, typically on a video monitor, a projection 
screen, etc . 

According to a first embodiment , the output of the 
image sensor is connected to an electronic circuit 
15 controlling the modulator alternately for a modulation 
for analysis purposes and for a modulation for 
filtration purposes calculated according to the image 
seen by the image sensor during the previous analysis 
phase and active during the recording phase. 

20 

Advantageously, the circuit disables the transmission 
of the electrical signal from the image sensor to the 
visualization means during the analysis phases . 

25 Preferably, the electronic circuit transmits to the 
visualization means , during the analysis phases , a 
prerecorded image corresponding to the image 
transmitted by the image sensor before the analysis 
phase . 
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According to a variant, the electronic circuit controls 
the light modulator during the analysis phase, so that 
it presents a uniform transmission rate over the entire 
5 surface area, with a transmission value corresponding 
to a value Vt less than 1. 

According to a particular embodiment, said value Vt is 
determined according to the brightness of at least one 
10 previous image. 

According to a first variant, the light modulator is a 
liquid crystal filter . 

15 According to another variant , said light modulator is a 
reflection filter . 

According to a third variant, said light modulator is a 
transmission filter . 

20 

Preferably, said light modulator is placed in the focal 
plane of an input lens . 

According to a particular embodiment, the light 
25 modulator is a steerable micromirror filter. 

According to a preferred variant, the light modulator 
has a maximum transmission rate that is uniform over 
the entire surface area in a waveband. 
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Preferably, said waveband corresponds to the red. 

Advantageously, the light modulator has a transmission 
5 rate that is adjustable in a waveband. 

According to a variant, said waveband is the 750 nm - 
14 0 0 nm band. 

10 The invention also relates to a method of processing an 
image acquired by an image sensor, comprising a step 
for filtering by a light modulator controlled by a 
periodically re-evaluated masking image, characterized 
in that it comprises, alternately, a step for acquiring 

15 an image and analyzing said image to prepare a masking 
image , and a filtering step during which the image is 
acquired by the image sensor after insertion of said 
light modulator controlled by the previously re- 
evaluated masking image , the steps for acquiring images 

20 to control the light modulator and for reproducing the 
corrected image being performed by the same image 
sensor . 

Advantageously, the images reproduced during the 
25 analysis step correspond to a previous corrected image. 

Preferably, the analysis step is performed in a time 
less than the retinal persistence time. 
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The invention also relates to an accessory of a 
photographic or video exposure device, for correcting 
the image acquired by an image sensor, characterized in 
that it comprises an active light modulator controlled 
5 by a filtering image periodically re-evaluated by a 
circuit receiving the image acquired by the image 
sensor and periodically controlling the presentation by 
the light modulator of a reference filtering image 
during the analysis phases . 

0 

According to a variant, the circuit also disables the 
link between the image sensor and the output of the 
exposure device during the analysis phases . 



15 The invention will be better understood from reading 
the description that follows, referring to a non- 
limiting exemplary embodiment, in which: 

- figure 1 represents the optical diagram of a device 
according to the invention, 

2 0 - figure 2 represents a view of an embodiment variant, 

- figure 3 represents the general architecture of a 
device according to the invention, 

- figure 4 represents a schematic view of a modulator 
implemented by the invention, 

2 5 - figure 5 represents the theoretical block diagram of 
the electronic circuit , 

- figure 6 represents the theoretical block diagram of 
the filtering module, 

- figure 7 represents the response curve of the 
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filtering function, 

- figures 8 and 9 represent the thresholding table and 
the corresponding response curve , 

- figure 10 represents the operating algorithm of the 
5 device, 

- figures 11 and 12 represent the thresholding table 
and the corresponding response curve for a variant 
with several threshold levels. 

10 The device according to the invention comprises an 
image sensor (1) , for example the sensor of a digital 
video camera or a digital photographic apparatus . An 
adaptive light modulator (2) is inserted on the optical 
path. It is placed in the image plane of an input lens 

15 (3) focusing the observed image in the plane of the 
light modulator (2 ) . An output optical system (4 ) is 
placed between the light modulator (2) and the optical 
system of the camera. It is, of course, possible to 
combine the output optical system (4) and the optical 

2 0 system of the exposure device in a single optical 
block. 

A computer (5) is linked to the output of the image 
sensor ( 1 ) . It control s the adapt ive 1 ight modulator 
25 (2) and the video output of the device. In the example 
described, it includes a video memory. 

The computer periodically carries out the following 
functions : 
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1 - Analysis: during this step, the computer (5) 
controls the light modulator (2) for the formation of a 
reference masking image, for example a filtering image 

5 exhibiting a uniform filtering rate over the entire 
surface area of the light modulator, to produce a 
uniform gray filter. This uniform filtering rate can be 
variable, and literally translated by a color, ranging 
from white (zero filtering or maximum transmission) to 
10 black (maximum filtering or minimum transmission) . The 
output of the image sensor (1) delivers an image with 
an overall reduced brightness level. 

2 - Evaluation of a new masking image. During this 
15 step, the computer determines the high intensity 

regions to calculate a new masking image . The regions 
with a brightness exceeding a threshold value will be 
totally or partially masked. 

2 0 3 - Acquisition of a filtered image : the computer (5) 
sends to the light modulator (2) a re-evaluated 
filtering image, and the light modulator presents a 
configuration totally or partially obscuring the high 
intensity regions. The image acquired by the sensor (1) 

25 is transmitted to the video output for visualization of 
a processed image. 

During the steps 1 and 2, the image available on the 
video output can comprise an image recorded in a video 
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memory ( 6 ) , corresponding to the previous processed 
image . 

The duration of the steps 1 and 2 is less than the 
5 retinal persistence time . 

The cycle is preferably carried out at a rate of 
greater than 25 processes per second . 

10 The reference image controlling the light modulator 
during the step 1 is a constant transmission image, the 
level of which can, if necessary, be adjusted by 
analysis of the intensities of the images of the 
preceding cycles. This variant makes it possible to 

15 optimize the brightness level of the images during the 
steps 1 and 2, and improve thresholding efficiency. It 
is also possible to provide non-uniform reference 
images , presenting a lower transmission rate in the 
regions with a super -brightness probability determined 

20 on the basis of the information available on the prior 
images. In this case, the calculation of the masking 
image will take into account the profile of the 
reference image for the calculation of the new masking 
image . 

25 

The masking can depend on the wavelength: for 
automobile applications, it is, for example, proposed 
to allow, in all circumstances, a high or even maximum 
transmission rate in the wavebands corresponding to 
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security signals, for example, in the red corresponding 
to stop lights and traffic lights. 

Figure 2 represents a view of the optical diagram of an 
5 embodiment variant implementing a reflection light 
modulator and not a transmission light modulator . The 
light modulator (12) is made up of micromirrors, the 
orientation of which is controlled between a position 
of reflection towards the image sensor and a position 

10 of dispersion or reflection towards a light trap. The 
micromirrors corresponding to the regions of high light 
intensity are controlled to scatter the incident beam 
or redirect it to a light trap, whereas the other 
micromirrors are oriented to reflect the incident beam 

15 towards the image sensor (1) . 

Figure 3 represents the general architecture of a 
device according to the invention. 

20 The device conventionally comprises an input optical 
system (19) forming an image in the focal plane of a 
light modulator (20) and an image sensor (21) driven by 
an electronic control circuit (23) . 

25 The control circuit (23) drives the operation of the 

light modulator (20) and the image sensor (21) , and 

delivers the video signal intended for the 
visualization means. 
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The control circuit (23) ensures the match between the 
light modulator and the image sensor, which are 
normally in matrix form. The optical match between the 
two ensures a correlation between a group of pixels Mi 
5 of the light modulator and a group of pixels Ci of the 
image sensor . 

In an embodiment, the light modulator has a resolution 
of 96 0 x 72 0 , the image sensor has a resolution of 
10 640 x 480 (VGA) . 

This light modulator is divided into groups of pixels 
made up of 3 x 3 pixels , or 32 0 x 24 0 groups of pixels 
Mi (i varying from 1 to 76800) as diagrammat ically 
15 represented in figure 4 . 

This image sensor is divided into as many groups of 

pixels Ci optically corresponding with the groups of 

pixels Mi of the light modulator (or of the Ci 
20 comprising 2x2 pixels) . 

Definition of the signals Gi of the light modulator 

The transmission rate of the group of pixels Mi of the 
25 light modulator is equal to Vti = Vtmax x Gi, where Gi 
is the gray level of the group of pixels Mi of the 
light modulator. 

Gi varies from the value Vtmin/Vtmax when it concerns 
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the "black" level, to 1 when it concerns the "white" 
level. Gi therefore varies from l/c to 1. 

Definition of the signals Yi of the image sensor 

5 

The luminance of the group of pixels Ci of the image 
sensor is determined according to the luminance of each 
of the constituent pixels (depending on the 
implementation method, it may be the maximum of the 
10 values of the group or the average of the values of the 
group or the value of a preferred pixel in the group) . 

It is equal to Li = Lmax x Yi, where Yi varies from the 
value Lmin/Lmax to 1 . 

15 

Lmin and Lmax are respectively the minimum and maximum 
luminances of the image sensor, they depend on the 
current operating mode for the image sensor (shutter 
time, etc) . The following expression also applies: 
2 0 Lmax/ Lmin = d, with d > 1. 

Yi therefore varies from 1/d to 1. 

Transmission rate of a group of pixels 

25 

The transmission rate Vti of the group of pixels Mi of 
the light modulator depends in particular on the 
transmission rates of each of the pixels that make up 
the group. 
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According to an embodiment, Vti is produced by 
uniformly setting all the pixels of Mi. 

5 According to another embodiment , Mi is made up of 3 x 3 
pixels. Vti is produced by setting the central pixel to 
Vtmax and the eight other pixels to one and the same 
value making the resultant over the nine pixels Vti, as 
diagrammatically represented in figure 4 . 

10 

According to a variant, the light modulator is made up 
of a matrix of micromirrors. 

The use of a matrix of micromirrors as the light 
15 modulator presents a number of advantages: 

- Vtmax i s high . 

- c is high. 

- Modulation times are fast. 

2 0 The Gi can be set using time modulation rates (duty 
cycles) . 

The modulator can be driven according to two operating 
modes . 

25 

According to the first operating mode, the device 
operates alternately in "analysis mode" and in 
"recording mode". 
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According to the second operating mode, the "analysis 
mode" is concurrent with the "recording mode". 

In the first operating mode, a cycle comprises a period 
5 containing an analysis phase followed by a recording 
phase . 

Ideally, since the recording mode is the effective 
mode, the latter lasts longer than the analysis mode. 

10 

The core of the device is the electronic intelligence 
circuit (22) which synchronizes the various elements 
and which manages all the signals according to the mode 
(analysis or recording) . 

15 

Exemplary implementation: description of five families 
of signals for a complete cycle 

In analysis mode : 

20 

Step 1: The electronic circuit (22) controls the light 
modulator to present a uniform transmission rate over 
the entire surface area equal to Vtan = Vtmax x Gan 
with Gan smaller than 1. 

25 

In an embodiment, Gan = 1/100. 

Step 2 : The electronic circuit controls the shutter 
time of the image sensor to a fraction of the shutter 
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time of the recording mode of the preceding cycle (or 
to a predefined startup value, if it is the first 
cycle) : Tshutteran = Tshutterrec x Tan with Tan smaller 
than 1 . 

5 

According to a preferred case, every effort is made to 
set Gan and Tan such that the product of Gan x Tan is 
as great as possible and less than or equal to 1/c. 
According to the best case, Gan x Tan = l/c. 

10 

In an embodiment, Tan = 1/10. 

Step 3: The electronic circuit acquires the signal from 
the image sensor. It processes this information with an 
operating algorithm and the other parameters in its 
possession (including the control parameters with which 
it is controlling the light modulator and the image 
sensor) . The result of this processing will then be 
used in the following recording phase. 

Step 4: The electronic circuit informs that the current 
mode is the analysis mode and does not transmit 
information from the image sensor. 

25 Step 5: The signal transmitted to the visualization 
means is a reproduction of the signal transmitted to 
the visualization means at the end of the preceding 
recording phase . 



15 



20 
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Step 1 : The electronic circuit controls the light 
modulator to present a filtering modulation calculated 
5 when processing the signals 11 3" of the preceding 
analysis phase. 

Step 2: The electronic circuit controls the parameters 
of the image sensor (shutter time, gain, etc) . These 
10 parameters are calculated when processing the signals 
of step 3 of the preceding analysis phase. 

Step 3 : The electronic circuit acquires the signal from 
the image sensor. 

15 

Step 4 : The electronic circuit transmits the signal 
from the image sensor and the values of the control 
parameters with which it is controlling the light 
modulator and the image sensor. 

20 

Step 5: The signal transmitted to the visualization 
means is produced from the data of the signals of 
step 4 . 

2 5 Example of processing within the electronic circuit : 
link between Gi in recording mode and Yi in analysis 
mode 

As detailed in the preceding section in the description 
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of the signals of step 3 in analysis mode and step 1 in 
recording mode, the filtering modulation in a recording 
phase is dependent in particular on the signal from the 
image sensor of the preceding analysis phase. This 
5 means that Gi in a recording phase is, in particular, 
dependent on Yi from the preceding analysis phase . 

The relationship between this Gi and this Yi is one of 
the important aspects of the operation of the 
10 electronic circuit. This relationship or "filtering 
transfer function" is symbolized by: Gi = F ( Yi ) . 

It can be a mapping table of the type of a single 
"look-up table" recorded in the electronic circuit, 
15 either programmable by the user or chosen by the 
electronic circuit (within a catalog of tables recorded 
in its memory) according to parameters. 

It can be a function with conditions. In an 
2 0 implementation : 

If Yi < Gan x Tan then Gi = 1 

If Yi > Gan x Tan then Gi = Gan x Tan / Yi 

If Yi > c x Gan x Tan then Gi = l/c 

25 It can be a direct function. 

In an implementation, the function is: 

Gi = Gan x Tan / Yi . 
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In an implementation, the function is: Gi = d x (1- 
c) x Yi / (c x (d-1) ) + (c x d - 1) / (c x (d-1) ) . 

In an implementation, the function is logarithmic: 
5 Gi = l/c + (1-c) x log(Yi) / (c x log (d) ) . 

It can be a simple comparison with a threshold value 
THR: 

If Yi < THR then Gi = 1 
10 If Yi > THR then Gi = l/c 

Particular case of signals of step 3 in analysis mode 

To speed up the transfer time of the image to the 
15 electronic circuit, and/or the processing time, it is 
possible to make do with acquiring a fraction of the 
pixels of the image sensor. In practice, as explained 
in section 1.2, the useful information can concern only 
a group of pixels; it is therefore only necessary to 
20 acquire a single data item for each group of pixels. 

Such an example is the use of the image sensor in 
"bining" mode (averaging of a number of adjacent pixels 
towards a single output data item) . 

25 

Exemplary architecture of the electronic circuit 

Figure 5 represents the simplified architectural 
diagram of the electronic intelligence: 
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It comprises a multiplexer (30) receiving data from a 
memory (31) containing the recording control 
parameters, and a memory (32) containing the analysis 
5 control parameters (Tan, etc) . 

It also comprises a synchronization machine (33) 
delivering data to a second multiplexer (34) . 

10 A third multiplexer (3 5) receives the data from a 
filtering circuit (36) and from the modulator Gan (37) . 

A synchronization machine is synchronized with the 
image sensor (as master or as slave) . It switches the 
15 signals according to the mode (analysis or recording) . 

In analysis mode: 

"1": A multiplexer (34) defines a uniform transmission 
20 rate for the "Gan" modulator (37) . 

"2 " : A multiplexer defines the image sensor control 
parameters for the analysis mode (Tan, etc) . 

25 "3" : The signals Yi are switched by a multiplexer to a 
memory Ml. They are then processed with the filtering 
transfer function (see 2.2). 

In recording mode: 
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" 1" : A multiplexer defines the filtering modulation 
from the processing derived from the filtering transfer 
function (36) . 

5 

"2": A multiplexer defines the image sensor control 
parameters for the recording mode. 

"3 " : The signals Yi are switched by a multiplexer to a 
10 memory M2 where they are stored for forwarding to the 
electronics for the visualization means. 

Particular cases of signals "1" in analysis mode 

15 In one case of implementation, all the groups of pixels 
Mi of the modulator are managed identically. In 
contrast, within a group, the pixels are managed 
differently. For example, all the pixels can be set to 
Vtmin, except one pixel set between Vtmin and Vtmax. 

20 

In one case of implementation, the signals "1" of an 
analysis mode are dependent on the signals 11 1" of the 
preceding recording mode. For example, if Girec < THR 
then Gian = l/c where THR is a threshold value. 

25 

General principle of the second operating mode 

The basic idea remains the same: a light modulator is 
controlled according to information from the own image 
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sensor that it is protecting from glare . However, there 
are not two alternating modes as in the first operating 
mode, the principle being a constant active control 
with feedback . 

5 

In the "alternate" operating mode, the electronic 
intelligence determines the filtering modulation using 
an analysis phase. 

10 In the feedback operating mode described here, there is 
no analysis phase; there is therefore only one 
operating mode , divided into cycles . This makes it 
possible to avoid having 11 ineffective time " periods in 
a cycle (such as the analysis phase) and therefore to 

15 have a maximum of useful time for the exposure time on 
the image sensor. 

Figure 6 represents the theoretical block diagram of 
the filtering module corresponding to this second 
2 0 operating mode. 

The filtering modulation is determined according to the 
modulation applied in the preceding cycle and the 
information seen by the retina also in the preceding 
25 cycle. 

Gi of the cycle n+1 depends on Gi of the cycle n and Yi 

of the cycle n: 

Gi(n+1 = A[ Gi(n) ; Yi (n) ] 



Copied .from .10584243 on 03/22/2007 



- 23 - 

A[ ] is the "filtering function" of this embodiment, 
the principle of which is given below (Ml and M2 are 
memories) . 

5 

Figure 7 represents the response curve of the filtering 
function. 

The filtering circuit produces a representation by 
10 thresholding in order to determine whether the 
modulator needs to be passing (Gi = 1) or blocking 
(Gi = 1/c) . 

Assume two threshold levels SI and S2 : 
15 If Yi (n) > SI, then Gi (n+1) = l/c 
If Yi (n) < S2, then Gi (n+1) = 1 

The threshold SI is determined according to the 
required photometric characteristics. 

20 

The threshold S2 is defined according to SI in order to 
ensure a good feedback : S2 = Sl/c - 

_ being the hysteresis needed to avoid interference of 
25 the control function. 

Figures 8 and 9 represent the thresholding table and 
the response curve corresponding to a number of 
filtering levels determined by different threshold 



Copied .from .10584243 on 03/22/2007 



- 24 - 



levels . 

Figure 10 represents the operating algorithm of the 
device . 

5 

At the outset, the modulator is totally transparent, 
all the pixels being in passing mode. 

There then follows the acquisition of an image n, and, 
10 at the same time, the reproduction on a visualization 
screen, and the analysis of the image, beginning with 
reading of the brightness level of a first pixel i. 

If the state of the corresponding pixel is blocking, 
15 the brightness value is compared with a threshold value 
2, and the state of this pixel is modified or 
maintained according to the result of the comparison. 

If the state of the corresponding pixel is passing, the 
2 0 brightness value is compared with a threshold value 1 , 
and the state of this pixel is modified or maintained 
according to the result of the comparison. 

This processing is repeated for each pixel , which leads 
25 to an ongoing recalculation of the filtering provided 
by the modulator, during image acquisition. 

This filtering can be performed with reference to a 
number of threshold values, as diagrammatically 
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represented in figures 11 and 12 corresponding to the 
thresholding table and the response curve . 
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